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Abstract — The problem of network coding for mul- 
ticasting a single source to multiple sinks has flrst 
been studied by Ahlswede, Cai, Li and Yeung in 2000, 
in which they have established the celebrated max- 
flow mini-cut theorem on non-physical information 
flow over a network of independent channels. On the 
other hand, in 1980, Han has studied the case with 
correlated multiple sources and a single sink from the 
viewpoint of polymatroidal functions in which a nec- 
essary and sufficient condition has been demonstrated 
for reliable transmission over the network. This pa- 
per presents an attempt to unify both cases, which 
leads to establish a necessary and sufficient condition 
for reliable transmission over a noisy network for 
multicasting all the correlated multiple sources to all 
the multiple sinks. Furthermore, we address also the 
problem of transmitting "independent" sources over 
a multiple-access-type of network as well as over a 
broadcast-type of network, which reveals that the (co- 
) polymatroidal structures are intrinsically involved in 
these types of network coding. 

1. Introduction 

On the other hand, in 1980, Han O had studied the 
case with correlated multiple sources and a single 
sink from the viewpoint of polymatroidal functions 
in which a necessary and sufficient condition has 
been demonstrated for reliable transmission over a 
network. 

This paper presents an attempt to unify both cases 
and to generalize it to quite a general case with 
stationary ergodic correlated sources and noisy 
channels (with arbitrary nonnegative real values of 
capacity that are not necessarily integers) satisfying 
the strong converse property (cf Verdu and Han Q, 
Han |4|), which leads to establish a necessary and 
sufficient condition for reliable transmission over a 
noisy network for multicasting correlated multiple 
sources altogether to every multiple sinks. 



It should be noted here that in such a situation 
with correlated multiple sources, the central issue 
turns out to be how to construct the matching 
condition between source and channel (i.e., joint 
source-channel coding), instead of of the traditional 
concept of capacity region (i.e., channel coding), 
although in the special case with non-correlated 
independent multiple sources the problem reduces 
again to how to describe the capacity region. 

Several network models with correlated multiple 
sources have been studied by some people, e.g., 
by Barros and Servetto 1.101, Ho, Medard, Effros 
and Koetter ||T4l, Ho, Medard, Koetter, Kai-ger, 
Effros, Shi and Leong ifTSll . Ramamoorthy, Jain, 
Chou and Effros |[T6l. Among others, LMJ, QS) 
and 1 16 1 consider (without attention to the converse 
part) error-free network coding for two (or possibly 
multiple) stationary memoryless correlated sources 
with a single (or possibly multiple) sink(s) to study 
the error exponent problem, where we notice that 
all the arguments in lfT4ll . ifTSi and [16| can be 
validated only within the class of stationary mem- 
oryless sources of integer bit rates and error-free 
channels (i.e., the identity mappings) all with one bit 
capacity (or integer bits capacity, which is allowed 
by introducing multiple edges); these restrictions 
are needed solely to invoke "Menger's theorem" in 
graph theory. The main result in the present paper is 
quite free from such seemingly severe restrictions, 
because we can dispense with the use of Menger's 
theorem. 

On the other hand, ifTOl revisits the same model 
as in Han |3|, while |T6| mainly focuses on the 
network with two correlated sources and two sinks 
to discuss the separation problem of distributed 
source coding and network coding, where, in ad- 
dition, cases of two-sources three-sinks, and three- 



sources two-sinks are also studied. It should be 
noted that, in the case of networks with correlated 
multiple sources, such a separation problem is 
another central issue. In this paper, we describe a 
necessary and sufficient condition for separability in 
the case with multiple sources and multiple sinks, 
(cf. Remark [5^. 

On the other hand, we may consider another net- 
work model with independent multiple sources but 
with multiple sinks each of which is required to 
reliably reproduce a prescribed subset of the multi- 
ple sources that depends on each sink. However, 
the problem with this general model looks quite 
hard, although, e.g., Yan, Yeung and Zhang [12j 
and Song, Yeung and Cai lfT3l have demonstrated 
the entropy characterizations of the capacity region, 
which still contain limiting operations and are not 
computable. Incidentally, Yan, Yang and Zhang 
||23l have considered, as a computable special case, 
degree-2 three-layer networks with /-C-pairs trans- 
mission requirements to derive the explicit capacity 
region. In this paper, for the same reason, we focus 
on the case in which all the correlated multiple 
sources is to be multicast to all the multiple sinks 
and derive a simple necessary and sufficient match- 
ing condition in terms of conditional entropy rates 
and capacity functions. This case can be regarded 
as the network counterpart of the non-network com- 
pound Slepian-Wolf system [22J. 

We notice here the following; although throughout 
in the paper we are encountered with the subtleties 
coming from the general channel and source char- 
acteristics assumed, the main logical stream re- 
mains essentially unchanged if we consider simpler 
models, e.g., such as stationary correlated Markov 
sources together with stationary memoryless noisy 
channels. This means that considering only simple 
cases does not help so much at both of the con- 
ceptual and notational levels of the arguments. For 
this reason, we preferred here the compact general 
settings. 

The present paper consists of six sections. In Sec- 
tion |2] notations and preliminaries are described, 
and in Section |3] we state the main result as 



well as its proof In Section |4] two examples are 
shown. Section|5]provides another type of necessary 
and sufficient condition for transmissibility. Also, 
some detailed comments on the previous papers 
are given. Finally, in Section |6] we address the 
routing capacity problems with polymatroids and 
co-polymatroids. 

2. Preliminaries and Notations 

A. Communication networks 

Let us consider an acyclic directed graph G = 
iV,E) where V = {1, 2, • • • , |y |} < +oo), 
E C V xV,hut {i, i) ^ E for all i e V. Here, 
elements of V are called nodes, and elements (i, j) 
of E are called edges or channels from i to j. Each 
edge is assigned the capacity Cij > 0, which 
specifies the maximum amount of information flow 
passing through the channel If we want to 

emphasize the graph thus capacitated, we write 
it as G = {V,E,C) where C = (cij)(ij)g£;. 
A graph G = (V, E, C) is sometimes called a 
(communication) network, and indicated also by 
J\f = {V,E,C). We consider two fixed subsets 
$, * of y such that <& n * = (the empty set) 
with 

"5 {S1,S2, - ■ ■ ,Sp}, 
* = {ti,t2, •••,*?}, 

where elements of $ are called source nodes, while 
elements of are called sink nodes. Here, to avoid 
subtle irregularities, we assume that there are no 
edges {i, s) such that s S $. 

Informally, our problem is how to simultaneously 
transmit the information generated at the source 
nodes in $ altogether to all the sink nodes in ^I^. 
More formally, this problem is described as in the 
following subsection. 

B. Sources and channels 

Each source node s G $ generates a stationary and 
ergodic source process 

X,^{Xi'\xP,---), (2.1) 



where Xs {i — 1,2,---) takes values in finite 
source alphabet Xg- Throughout in this paper we 
consider the case in which the whole joint process 
X,s> = {Xs)se<'i> is stationary and ergodic. It is then 
evident that the joint process Xt = {Xs)seT is 
also stationary and ergodic for any T such that 
7^ r C The component processes Xg (s G $) 
may be correlated. We write Xt as 

XT = iX^'\x^.^\---) (2.2) 

and put 

where X^^ {i = 1,2,---) takes values in Xt = 

On the other hand, it is assumed that all the 
channels [i,]) E E, specified by the transition 
probabilities Wij : Afj — > with finite in- 

put alphabet Aij and finite output alphabet Bij, 
are statistically independent and satisfy the strong 
converse property (see Verdu and Han fT\}. It 
should be noted here that stationaty and memoryless 
{noisy or noiseless) channels with finite input/output 
alphabets satisfy, as very special cases, this property 
(cf. Gallager [11, Han [4]). Barros and Servetto [10| 
have considered the case of stationary and mem- 
oryless sources/channels with finite alphabets. The 
following lemma plays a crucial role in establishing 
the relevant converse of the main result: 

Lemma 2.1: (Verdu and Han Q) The channel 
capacity Cij of a channel wij satisfying the strong 
converse property with finite input/output alphabets 
is given by 

c„ = lim -max/(X";r"), 

where X" , F" are the input and the output of the 
channel Wij, respectively, and I{X'"-;Y") is the 
mutual information (cf. Cover and Thomas ||9|). ■ 

C. Encoding and decoding 

In this section let us state the necessary operation 
of encoding and decoding for network coding with 



correlated multiple sources to be multicast to mul- 
tiple sinks. 

With arbitrarily small S > and e > 0, we 
introduce an {n, {Rij){ij)eE, S,e) code as the one 
as specified by ( |2.4| i ~ p.9| l below, where we use 
the notation [1, M] to indicate {1,2, - ■ ■ , M}. How 
to construct a "good" {n, {Rij)i^i j^^E: S^^) code 
will be shown in Direct part of the proof of Theorem 
EJ] 

1) For all (s,j) (s e the encoding function 

is 

: A-;^ [1,2"(«--*)], (2.4) 

where the output of fsj is carried over to the 
encoder ipsj of channel Wsj, while the decoder 
ipsj of Wsj outputs an estimate of the output of 
fsj, which is specified by the stochastic composite 
function: 

hsj = ijjsj o ws, o <^,, o fsj : -> [1, 2"(^--^)]; 

(2.5) 

2} For all (i ^ $), the encoding function 

is 

k:{k,i)£E 

(2.6) 

where the output of fij is carried over to the 
encoder ipij of channel Wij, while the decoder 
■^ij of Wij outputs an estimate of the output of 
fij, which is specified by the stochastic composite 
function: 

hij = 

o w., o o : Y{k■.ik.^)eE[^^ 2"(^--*)] 

-> [1,2"('^-^-*)]. (2.7) 

Here, if {k : {k,i) e E} is empty, we use the 
convention that fij is an arbitrary constant function 
taking a value in [1, 2"(^'J^'')]; 

3) For all t E 'i>, the decoding function is 

gt: n [1,2"(^--')] ^ (2.8) 

k:{k,t)eE 

4) Error probability 



All sink nodes i e 4* are required to reproduce a 
"good" estimate ^ (= the output of the decoder 
gt) of through the network TV = {V,E,C), 
so that the error probability Pr{X^ ^ 7^ -'^IS} be 
as small as possible. Formally, for all t E 'i', the 
probability A„.f of decoding error committed at sink 
t is required to satisfy 



(2.9) 



for all sufficiently large n. Clearly, JC^ ^ are the ran- 
dom variables induced by that were generated 
at all source nodes s e $. 

We now need the following definitions. 

Definition 2.1 (rate achievability): If there exists 
an {n, {Rij)(^ij-j^E, S,e) code for any arbitrarily 
small e > as well as any sufficiently small 5 > 0, 
and for all sufficiently large n, then we say that 
the rate {Rij)(i j)eE is achievable for the network 
G=iV,E). m 

Definition 2.2 (transmissibility): If, for any small 
r > 0, the augmented capacity rate [Rij — 
Cij + T)(i^j)^E is achievable, then we say that 
the source X^ is transmissible over the network 
TV = {V,E,C), where + t is called the r- 
capacity of channel ■ 



The proof of Theorem |3.1| (both of the converse 
part and the direct part) are based on these defini- 
tions. 

D. Capacity functions 

Let TV = (y, C) be a network. For any subset 
M C y we say that (M, M) (or simply, M) is a 
cut and 

EM = {{h])eE\i&M,i €M} 

the cutset of (M, M) (or simply, of M), where 
M denotes the complement of M in V . Also, we 
call 



c(M, M) 



E 



(2.10) 



{i,j)eE,ieM,jeM 



set) and for any t E (the sink node sets), 
define 

Pt{S)^ min _c(M,M); (2.11) 

M:SCM,teM 

PAfiS) = min pt (S*) . (2. 12) 

We call this pjs/{S) the capacity function of 5 C 
for the network TV = {V,E,C). 

Remark 2.1: A set function (t{S) on $ is called a 
co-polymatroid j^] (function) if it holds that 

1) ^(0) - 0, 

2) a{S)<a{T) {ScT), 

3) a{SriT) + a{SUT)>aiS)+a{T). 

It is not difficult to check that a{S) = H{Xs\X-g) 
is a co-polymatroid (see, Han jS)). On the other 
hand, a set function p{S) on $ is called a polyma- 
troid if it holds that 

1') p(0) = 0, 

2') piS)<p{T) (ScT), 

3') p(5nT)+p(5ur)<p(5)+p(T). 

It is also not difficult to check that for each < e 



the value of the cut (M, M). Moreover, for any 
subset S such that ^ S' C $ (the source node 



the function pt{S) in (2.11 1 is a polymatroid (cf. 
Han |3J, Meggido |24|), but p^^{S) in \2.12\ ) is not 
necessarily a polymatroid. These properties have 
been fully invoked in establishing the matching con- 
dition between source and channel for the special 
case of 1*1 1 ( cf. Han |3J). ■ 

With these preparations we will demonstrate the 
main result in the next section. 

3. Main Result 

The problem that we deal with here is not that 
of establishing the "capacity region" as usual, be- 
cause the concept of "capacity region" does not 
make sense for the general network with correlated 
sources. Instead, we are interested in the matching 
problem between the correlated source X^ and 
the network TV = (V, E, C) (transmissibility: cf. 

*In Zhang, Chen, Wicker and Berger 1191 . the co-polymatroid 
here is called the confra-polymatroid. 



Definition \2.2\ . Under what condition is such a 
matching possible? This is the key problem here. 
An answer to this question is just our main result 
to be stated here. 

Theorem 3.1: The source X$ is transmissible over 
the network TV = {V, E, C) if and only if 



H{Xs\Xg) < pm{S) (0^V5c$) 
holds. ■ 



(3.13) 



Remark 3.1: The case of l^fj — 1 was investigated 
by Han |[3l, and subsequently revisited by Barros 
and Servetto fW\, while the case of |<I>| = 1 was 
investigated by Ahlswede, Cai, Li and Yeung HI. 
■ 

Remark 3.2: If the sources are mutually indepen- 
dent, ( |3.13| l reduces to 



Then, setting the rates as Ri 
another equivalent form: 



H{Xi) we have 
(3.14) 



Y.R^<P^r{S) (0=^V5ca>). 

iGS 

This specifies the capacity region of independent 
message rates in the traditional sense. In other 
words, in case the sources are independent, the 
concept of capacity region makes sense. In this 
case too, channel coding looks like for non-physical 
flows (as for the case of |$| = 1, see Ahlswede, Cai, 
Li and Yeung [1]; and as for the case of j^j > 1 
see, e.g., Koetter and Medard fVT\, Li and Yeung 
ifTSl ). It should be noted that formula p.l4[ ) is not 
derivable by a naive extension of the arguments 
as used in the case of single-source (|$| = 1), 
irrespective of the comment in ■ 

Proof of Theoren \3J] The proof is based on joint 
typicality, strong converse property of the channel, 
acyclicity of the network, ergodicity of the source, 
random coding arguments, Fano's inequality, subtle 
classification of the error patterns, and so on. As 
for the details, see Han ||5l). 



4. Examples 



In this section we show two examples of Theorem 



3.1 with $ = {S1.S2} and ^ = {ti.t2}. 



Example 1. Consider the network as in Fig. 1 (called 
the butterfly) where all the solid edges have capacity 
1 and the independent sources Xi , X2 are binary 
and uniformly distributed. The capacity function of 
this network is computed as follows: 

Pti({s2}) = pt2({si}) = l, 
PtA{si}) = P*,({S2}) = 2, 
Pti({si,S2}) pt:,{{si,S2}) =2; 

PAr{{si}) = min(pt^({si}),pt,({si})) = 1, 
Pm{{s2}) = min(pt,({s2}),pt2({s2})) = 1, 
PAf{{si,S2}) = min(pt,({si,S2}),Pt2({si,S2})) 
= 2. 



On the other hand, 

HiX,\X2) - 
H(X2\Xi) = 
H{XiX2) - 



H{X,) 
H{X2) 
H{X,) 



H{X2) = 2. 



Sl 



Si 





t2 



Fig. 1. Example 1 



Therefore, condition p.l3[ ) in Theorem |3.1| is satis- 
fied with equality, so that the sourse is transmis- 
sible over the network. Then, how to attain this 
transmissibility? That is depicted in Fig.2 where 
© denotes the exclusive OR. Fig. 3 depicts the 
corresponding capacity region, which is within the 



framework of the previous work (e.g., see Ahlswede 
et al. IT]). 



Si 



S2 




h t2 

XIX2 XIX2 
Fig. 2. Coding for Example 1 



X2 




follows: 

Ptl({s2}) 

Pti({si}) 

Pti({si,S2}) 

P^^{{s2}) 

PA^({si}) 
PA^({Si,S2}) 

On the other hand, 



Pt2{{si}) = h{p), 
PtA{s2}) ^l + h{p), 
PtA{si,S2})^mm{l + 2h{p),2); 

min(pti({s2}),Pt2({s2})) = Hp), 
min(pti({si}),pt2({si})) = h{p), 

min(pti ({si , S2}), pt2 ({si, S2})) 
= 2. 



i/(Xl|X2) 
H(X2|Xi) 



Hp), 
i + Kp). 



u 



Ibit 



Fig. 3. Capacity region for Example 1 

Example 2. Consider the network with noisy chan- 
nels as in Fig.4 where the solid edges have capacity 
1 and the broken edges have capacity h{p) < 1. 
Here, h{p) (0 < p < ^) is the binary entropy de- 
fined by h{p) = -plog2p-(l-p)log2(l-_p). The 
source (Xi, X2) generated at the nodes si, S2 is the 
binary symmetric source with crossover probability 
p, i.e.. 



Pr{Xi = 1} 



= Pr{Xi=0} = 
= Pr{X2 = 0} = 



Pt{X2 
1 



1} 



Pi{X2 = l|Xi = 0} = Pt{X2 = Q\Xi = l}=p. 

Notice that Xi , X2 are not independent. The ca- 
pacity function of this network is computed as 



.^1 



x^ 

Si 




*1 t2 

Fig. 4. Example 2 
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Fig. 5. Coding for Example 2 



X2 




Therefore, condition p.l3| l in Theorem |3.1| is sat- 
isfied with strict inequahty, so that the source is 
transmissible over the network. Then, how to attain 
this transmissibility? That is depicted in Fig. 5 where 
xi, X2 are n independent copies of Xi,X2, respec- 
tively, and ^ is an TO X n matrix (to, — nh{p) < n). 
Notice that the entropy of xi © X2 (component- 
wise exclusive OR) is nh{p) bits and hence it is 
possible to recover xi X2 from j4(xi X2) (of 
length TO = nh{p)) with asymtoticaly negligible 
probability of decoding error, provided that A is 
appropriately chosen (see Korner and Marton fTP\). 
It should be remarked that this example cannot be 
justified by the previous works such as Ho et al. 
im. Ho et al. ifTSl, and Ramamoorthy et al. fW\, 
because all of them assume noiseless channels with 
capacity of one bit, i.e., this example is outside the 
previous framework. 



5. Alternative Transmissibility 
Condition 

In this section we demonstrate an alternative trans- 
missibility condition equivalent to the necessary 
and sufficient condition ( 3.13| l given in Theorem 
3J\ 



To do so, for each t € we define the polyhedron 
Ct as the set of all nonnegative rates {Rs;s e $) 
such that 

Y.R^<Pt{S) (0^V^c$), (5.15) 

where pt{S) is the capacity function as defined 
in (jTTTjl of Section [2] Moreover, define the poly- 
hedron TZsw as the set of all nonnegative rates 
{Rs] s e $) such that 

HiXs\Xs)<J2R^ (0^V5c$), (5.16) 
ies 

where H {X s\Xg) is the conditional entropy rate as 
defined in Section [2] Then, we have the following 
theorem on the transmissibility over the network 



Theorem 5.7.- The following two statements are 
equivalent: 

1) H(Xs\X^) < p^{S) (0^V5c$), 

(5.17) 

2) 7^swnC^7^0 (Vte*). (5.18) 



In order to prove Theorem 5.1 we need the follow- 
ing lemma: 

Lemma 5.7 (Han f3\y. Let a{S), p{S) be a co- 
polymatroid and a polymatroid, respectively, as 



defined in Remark 2.1 Then, the necessary and 
sufficient condition for the existence of some non- 
negative rates (T?^; s e $) such that 

< ^ i?, < piS) (0 ^ V5 c $) (5. 19) 



is that 



<j{S)<piS) (0 7^VS'c$). 



(5.20) 



Proof of Theorem 5.1 It is easy to see this 



Remark 5.7.- The necessary and sufficient condi- 



tion of the form (5.18 1 appears {without the proof) 



in Ramamoorthy, Jain, Chou and Effros lfT6l . which 
they call the feasibility. They attribute the suf- 
ficiency part simply to Ho, Medard, Effros and 
Koetter [14J with |$| = 2, l^-] = 1 (also, cf. Ho, 
Medard, Koetter, Karger, Effros, Shi, and Leong 
|15| with |$| = 2,|5'| = 1), while attributing the 
necessity part to Han Q, Barros and Servetto [[TOl . 
However, notice that all the arguments in IT4l . ifTSi 
(HH is included in Iil5i ) can be validated only 
within the class of stationary memoryless sources 
of integer bit rates and error-free channels (i.e., 
the identity mappings) all with one bit capacity 
(this restriction is needed to invoke "Menger's the- 
orem" in graph theory); while the present paper, 
without such "seemingly" severe restrictions, treats 
"general" acyclic networks, allowing for general 
correlated stationary ergodic sources as well as 
general statistically independent channels with each 
satisfying the strong converse property (cf. Lemma 
|2.1| i. Moreover, as long as we are concerned also 
with noisy channels, the way of approaching the 



problem as in |fT4l . ifTSll does not work as well, 
because in this noisy case we have to cope with 
two kinds of error probabilities, one due to error 
probabilities for source coding and the other due to 
error probabilities for network coding (i.e., channel 
coding); thus in the noisy channel case or in the 
noiseless channel case with non-integer capacities 
and/or i.i.d. sources of non-integer bit rates, llT6l 
cannot attribute the sufficiency part of (5.18 1 to lfT4l . 
[15 1. 

It should be noted here also that lfT4l and ifTSl . 
though demonstrating relevant error exponents (the 
direct part), do not have the converse part. ■ 

Remark 5.2 (Separation): Here, the term of sep- 
aration is used to mean "two step" separation of 
distributed source coding {Step 1: based on Slepian- 
Wolf theorem) and network coding with indepen- 
dent sources {Step 2: based on Theorem |3.1| with 
Remark 3.2 1. Now suppose that that there exist 



some nonnegative rates i?j (z e $) such that 
H{Xs\X^) <Y.R. < P^{S) (0 ^ V5 c 

(5.21) 

Then, the first inequality ensures reliable distributed 
source coding by virtue of the theorem of Slepian 
and Wolf {Step 1), while the second inequality 
ensures reliable network coding by virtue of Thje- 
orem 3.1 with Remark 3.2 for independent sources 



{Step 2), which looks like for non-physical flows, 
with independent distributed sources of rates Ri 
{i e $; see Remark [372| . Thus, ( 5.21| i is sufficient 
for separability. Condition ( |5.21 1 is equivalently 



written as 



(5.22) 



for any general network Af. Moreover, in view of 
Remark [3]2j it is not difficult to check that ( |5.22| i 
is also necessary. Thus, our conclusion is that, in 



general, condition (5.22i is not only sufficient but 
also necessary for separability in the sense above 
stated. ■ 

Remark 5.3: In this connection, lfT6l claims that, 
in the case with |$| = I^E'I ~ 2 and with rational 



capacities as well as sources of integer bit rates, 
"separation" always holds, while in the case of 
|<I>| > 2 or I I > 2 no conclusive claim is 
still not made. Although this seems to contradict 
Remark |5]2] it should be merely due to the different 
definitions for separability. 

Remark 5.4: It is possible also to consider net- 
work coding with cost. In this regard the reader 
may refer to, e.g., Han (|3l, Ramamoorthy 1281 . Lee 
et al. 129 1 . ■ 

Remark 5.5: So far we have focused on the case 
where the channels of a network are quite general 
but are statistically independent. On the other hand, 
we may think of the case where the channels are not 
necessarily statistically independent. This problem 
is quite hard in general. A typical tractable example 
of such networks would be a class of acyclic 
deterministic relay networks with no interference 
(called the Aref network) in which the concept 
of "channel capacity" is irrelevant. In this connec- 
tion, Ratnakar and Kramer 1,25] have studied Aref 
networks with a single source and multiple sinks, 
while Korada and Vasudevan f26] have studied 
Aref networks with multiple correlated sources and 
multiple sinks. The network capacity formula as 
well as the network matching formula obtained by 
them are in nice correspondence with the formula 
obtained by Ahlswede et al. [I] as well as Theorem 
|3.1 1 established in this paper, respectively. ■ 

6. Routing Capacity Regions 

So far we have considered the problem of multicas- 
ting multiple sources to multiple sinks over a noisy 
network in which all the sources may be mutually 
correlated. The fundamental toosl for this kind of 
reliable transmission are mainly routing and coding 
at each node of the network. Along this line we 
have established Theorem |3.1| to give a necessary 
and sufficient condition for reliable transmission. 
On the other hand, several class of network coding 
may not need the operation of coding but only 
that of routing. However, Theorem |3.1| does not 
provide any explicit suggestions or answers in this 
respect. 



In this section, we address this problem with mu- 
tually independent sources specified only by their 
rates Ri's. The set of all such achievable rates 
will be called the routing capacity of the net- 
work. In what follows, as illustrative cases, we 
take three types of network routings, i.e., multiple- 
access-type of routing, broadcast-type of routing, 
and interference-type of routing. In doing so, for 
each edge ^ E we impose not only upper 

capacity restriction but also lower capacity dij 
restriction (0 < < Cij), which means that 
information flows gij passing the channel {i,j) € E 
are restricted so that dij < gij < Cij for all 
E E. A motivation for the introduction of 
such lower capacities dij is that in some situations 
"informational outage" over a network is to be 
avoided, for example. 

Let us first state "Hoffman's theorem" in a graph 
theory which is needed to discuss the routing ca- 
pacities. For simplicity we put D = {dij)(i,j)£E 
like C — icij)(ij)^E^ and also write as [dij,Cij]. 



Definition 6.1: Given a graph G = {V, E, C, D), a 
flow gij is said to be circular if dij < gij < Cij for 
all e E, and Y.j(^v9^] = T.jev 9ji = for 
all z G y (the conservation law). ■ 

Theorem 6.1: [Hoffman's theorem] There exists a 
circular flow {gij : G E) if and only if 

c(M, M) > d(M, M) for all subset M C V, 

(6.23) 



where c(M, M) was specified in (2. 10 1 and 
d{M , M) is similarly defined by replacing c, M, M 
by d, M, M, respectively, where M denotes the 
complement of M in V .W 

E. Multiple-access-type of network routing 

Suppose that we are given a network M = 
{V, E, C, D) as in Fig.6: 

We modify this network by adding p fictitious edges 
as in Fig.7: 

to obtain the modified network 7V^* = (V, E*,C,D, 
[Ri, i?i], • • • , [Rp, Rp]). We notice here that a rate 




Fig. 7. Modified network Af* 

• • • , Rp) is achievable over the original net- 
work J\f if and only if the network Af has a circular 
flow. Thus, by writing down all the conditions in 
Hoffman's theorem for Af*, we obtain the following 
two kinds of inequalities: 

1 . M ^ M : 

^Ri> d{M, M) - c{M, M) = d*(M, M) 



{A c $, Af 9 ii, Af D A; M D A) 



Z.M^M: can be omitted 

^Ri< c{M, Af) - d{M, Af) = c*(M, Af ) 
C Af 3h,M ^A; Mp A) 

can be omitted 



Fig. 8. Conditions for aciiievability 

In order to express these conditions in a compact 
form, define the "capacity function" as follows: 

Definition 6.2: For each subset A of $, let 

Pm{A) = min{c*(M,M)\M 3ti,M D A}, 
amiA) = maK{d*(M,M)\M 3ti,M dA}. 



Theorem 6.2: pra{A), crin(^) are a polymatroid 
and a co-polymatroid, respectively. 



Theorem 6.3: 
only if 



There exists a circular flow if and 



Cm (-4) < pm{A) for all A C 



(6.24) 



and the routing capacity region of multiple-access- 
type of network is given by 

<Jm{A) < ^ i?, < pm{A) for all Ac^. (6.25) 

Proof: It suffices only to use Lemma [5T| ■ 

Remark 6.1: It is easy to see that CTm(^) = 
for all A C $ if = (for all e E), 



and hence Theorem 6.3 turns out to be a special 



case of Thorem 3.1 with independent sources. This 
implies that in this case the capacity region given 
by Thorem |3.1| can actually be attained only with 
network routing but without network coding. 

F. Broadcast-type of network routing 

Suppose that we are given a network M = 
{V, E, C, D) as in Fig.9: 




Fig. 9. Broadcast-type of network 

We modify this network by adding q fictitious edges 
as in Fig. 10: 




[Rq, Rq 



Fig. 10. Modified network A^* 



to obtain the modified network M* = {V,E*,C, D, 
i?i], • • • , [Rq,Rq]). Thus, in a similar manner, 
we have the achievabilitv conditions: 

1 . A/ ^ M : 

^ i?i < c(M, M ) - d(M, M) = c* (M, M) 

{A c 3 si,M ^ A-M ^A) 



2. M M : 



can be omitted 



^ i?j > d(M, M) - c{M, M) = d*[M, M) 
{A C M 9 si, M 3 A; M 3 A) 

can be omitted 

Fig. 1 1 . Conditions for achievability 

Accordingly, the "capacity function" is defined as: 

Definition 6.3: For each subset A of vp, let 

p^{A) = min{c*(M,M)|M 9 si,M D A}, 
(J^^{A) = max{d*(M,M)|M 9 si,M D A}. 

Theorem 6.4: p\^{A), (y^{A) are a polymati'oid 
and a co-polymatroid, respectively. 

Theorem 6.5: There exists a circular flow if and 
only if 

cTT^{A) < PY,{A) for an ^c^-, (6.26) 

and the routing capacity region of broadcast-type of 
network is given by 

o-b(^) <^Ri< PhiA) for all A C (6.27) 



Proof: It suffices only to use Lemma 5.1 



Remark 6.2: The capacity region { 6.27\ remains 
unchanged if network coding is allowed in addition 
to network routing.M 

G. Interference-type of network routing 

Suppose that we are given a network Af = 
{V,E,C\D) as in Fig. 12: 



Fig. 12. Interference-type of network 



We modify this network by adding p fictitious edges 
as in Fig. 13 below. 




[iJp, R 



Fig. 13. Modified network A^* 

In this case too, again by virtue of Hoffman's 
theorem, the achievability condition is summarized 

as 



max d*(M,M) 

(A.B) 



< 



min c*(M,M), (6.28) 



where max(^ B) (resp. min(^ s)) denotes max 
(resp. min) over all possible cuts (A/, M) and 
partitions (with A2 , A3 fixed) as was shown in 
Fig. 14: 

For simplicity, let us now consider the case with 
1*1 = 1*1=2: 

Then, the achivability condition reduces to that as 
in Fig. 16 below, where, on the contrary to the case 
of multiple-access-type of network routing as well 
as to the case of broadcast-type of network routing, 
the term i?i — R2 appears in addition to the term 
Ri + i?2, which suggests that the interference-type 
of network routing may be more complicated with 
a rather pathological behavior 



^ = A1UA2UA3UA4 
^ = BiU B2U Bali Bi 

Ai Bi, A2 B3, A3 <= B2, A, 
\Ar\ = \B,\, \A2\ = IS3I, 
IA3I = IB2I, \Ai\ = \B,\ 

Fig. 14. Conditions for achievability 
[fii.fii 




[R2,R2] 

Fig. 15. Modified network A/"* 



Case 1 : < i?i < min c(M , M) where 

[si e M, ti e 17] and [{s2 e M, t2 e M] 
or {s2 G M,t2 e M}] 

Case 2: < i?2 < niin c(M,M) where 

[s2 e M, t2 e M] and [{si e M, ti e A/} 
or {si e M,ii G M}] 

Case 3: < i?i + i?2 < minc(A/, A?) where 

[si e M, ti e AI] and [s2 £ M, t2 £ Af] 

Case 4: < i?i < minc(Af, M) + i?2, 

< i?2 < minc(Af, Af) + i?! where 

[si e M, ti e M] and [s2 e M, ^2 e Af] 



The following Fig. 17 shows a typical region of 



Fig. 16, which looks hke a rather untraditional 
shape. 



R2 




Fig. 17. "achievable" region 

For example, let us consider the network M as in 
Fig. 18. It is easy to check that the achievability 
condition in Fig. 16 for this network reduces to 
< i?i < i?2 < 1- Fig. 19 shows two elementary 
directed cycles: one with i?i = 0,i?2 = 1; the 
other with i?i ~ 1, i?2 — 1- The first flow actually 
specifies a flow in M, while the latter flow contains 
two fictitious edges and hence does not specify any 
flow in M. Thus, in the case of the interference-type 
of network, we have to take another approach to 
establish the routing capacity region. An approach, 
though brute, would be to list up all the elementary 
paths in M connecting source Si and sink ti for 
every i = 1, 2, • • • ,p; and, for every edge e of M, 
to check whether the total flow passing through e 
satisfies the upper and lower capacity constraints. 
Incidentally, it should also be remarked that any 
polymatroidal structure does not appear here. Any- 
way, Hoffman's theorem does not work as well 
for interference-type of networks. Thus, the routing 
capacity problem for interference-type of networks 
would be rather intractable and elusive, compared 
to multiple-access-type of networks and broadcast- 
type of networks. 
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